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1 Introduction 

We recently established the holomorphic continuation and functional equa- 
tion of the exterior square L-function for GL{n,'Z), and more generally, the 
archimedean theory of the GL{n) exterior square L-function over Q. We refer 
the reader to our paper |15j for a precise statement of the results and their 
relation to previous work on the subject. The purpose of this note is to give an 
account of our method in the simplest non-trivial cases, which can be explained 
without the technical overhead necessary for the general case. 

Let us begin by recalling the classical results, about standard L-functions and 
Rankin-Selberg L-functions of modular forms. We consider a cuspidal modular 
form F, of weight k, on the upper half plane Ti. To simplify the notation, we 
suppose that it is automorphic for F ~ S'L(2,Z), though the arguments can be 
adapted to congruence subgroups of 5L(2,Z). Like all modular forms, F has a 
Fourier expansion, 

F{z) = Y a„e(nz), with e(z) =dof e""^ (1.1) 

For a general modular form, the Fourier series may involve a non-zero constant 
term oq; it is the hypothesis of cuspidality that excludes the constant term. The 
Dirichlet series 

L(s,F) = ^.^nn-"^-^ (1.2) 

converges for Re s ^ 0, extends holomorphically to the entire s-plane, and sat- 
isfies a functional equation relating L(s, F) to L(l — s, F). This is the standard 
L-function of the modular form F. 

Hecke proved the holomorphic continuation and functional equation by ex- 
pressing L(s, F) in terms of the Mellin transform of F along the imaginary axis, 
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poo poc 

/ F{zy)y^-Uy = ^ a„ / e~'^^^y y^^Uy 

In ^ ^n>l In 

.00 - (1-3) 

at least for Re s 3> 0. The transformation law for the modular form F under 

^^(-1/^) - {-^^fF{^), (1-4) 

implies that F{iy) decays rapidly not only as y ^ 00, but also as y ^ 0. That 
makes the Mellin transform, and hence also T{s + ■^^) i(s, F)^ globally defined 
and holomorphic. The Gamma function has no zeroes, so L(s, F) is entire 
as well. The transformation law H1.4() . coupled with the change of variables 
y ^ l/y and the shift s + , gives the functional equation 

{2^)-^-'^T{s+^)L{s,F) = ^^^^ 
= i'^ (2^)^-1- Vr(l-s+^)L(l-s,F). 

The factor comes up naturally in the computation, yet might be misleading 
since T — SL(2, Z) admits only modular forms of even weights. 

In addition to F, we now consider a second modular form of weight k, which 
need not be cuspidal, 

^(^) = E (1-6) 

The Rankin-Selberg i-function of the pair F, G = complex conjugate of G, is 
the Dirichlet series 

L{s,F(g,G) = C(2s) V ^anKn'-"-'. (1.7) 

Its analytic continuation and functional equation were established separately 
by Rankin J7| and Selberg ^Sj. The proof depends on properties of the non- 
holomorphic Eisenstein series 

E.iz) ^ .-^r(.)c(2.)E,,,^,p(i-(7^))^ ^^^^^ 

(Too = {7Gr I 700 = 00}). 

This sum is well defined since Too acts on H by integral translations. It converges 
for Re s > 1 and extends meromorphically to the entire s-planc with only one 
pole, of first order, at s = 1. The function Es{z) is F- invariant by construction, 
has moderate growth as Im z ^ 00, and satisfies the functional equation 

E,{z) = Ei^,{z). (1.9) 

Both F{z) and G(z) transform according to a factor of automorphy under the 
action of T, but (Im z)''F{z)G{z) is F-invariant, as is the measure y^^dxdy. 



2 



Since G{z) and Es{z) have moderate growth as Im z ^ oo, and since F{z) 
decays rapidly, the integral 

I{s) = / {Im zf-^F{z)G{z)Es{z)dxdy (1.10) 
Jt\h 

converges. From Es{z), the function I{s) inherits both the functional equation 

I{s) = I{l~s) (1.11) 

and the analytic properties: it is holomorphic, with the exception of a potential 
first order pole at s = 1. 

The definition H1.8|) of Es{z) involves a sum of Im 72, with 7 ranging over 
roo\r. But the rest of the integrand in (|1.1U|) is F-invariant. That justifies the 
process known as "unfolding" , 

7r^{T{s)C{2s))-'l{s) = 

- E,,P^\P (I- ^r'Pi^)Giz) (Im {,z)ydxdy 

(Im zY+^-^F{z)G{z)dxdy, 

at least for Re s > 1, in which case the integral on the right converges. Since 
Too acts on H by integral translations, the strip {0<Rez<l} constitutes a 
fundamental domain for this action. Substituting the series (|1. 1111.6(1 for F{z) 
and G{z), one finds 



(1.13) 



7r^(F(.)C(2s))-^/(,s) = 

= / / E">o «"^™e((n-m)x)e-2-(«+'")V+'-'dxdy 

Jo Jo m>0 

nOO 

- (47r)-^-'=+i F(s + A; - 1) V ^ a„ 6„ n-^-'^'+i , 

again for Re s > 1. Equivalently, 

I{s) = 2^-''{2TT)^-''-^'r{s)T{s + k-l)L{s,F(g)G). (1.14) 

The Gamma factors have no zeroes, so L{s, F iS) G) extends holomorphically to 
all of C, except possibly for a first order pole at s = 1. In effect, (|1.11|) is the 
functional equation for the Rankin-Selberg L-function. With some additional 
effort one can modify these arguments, to make them work even when F and G 
have different weights. 

Maass ^21 extended the proofs of the analytic continuation and functional 
equation for the standard L-function to the case of Maass forms, i.e., F-invariant 
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eigenfunctions of the hyperbolic Laplacian on H] see section 2 below. Jacquet 
|S] treats the Rankin- Selberg L-function for Maass forms. We just saw how the 
Gamma factors in H1.3|l and H1.13|l arise directly from the standard integral rep- 
resentation of the Gamma function. In contrast, for Maass forms, the Gamma 
factor for the standard i-function arises from the Mellin transform of the Bessel 
function K^{y), 

poo 

/ K,{y)y'-' = r-^r{^)T{s±i^) (Res»0), (1.15) 
Jo 

and for the Rankin-Selberg L-function of a pair of Maass forms, from the integral 



KMK,{y)y'-Uy = 

= 2--^ ^ 2 Ml 2 Mi 2 Ml 2 J (Res»0). 

r(s) 

Though (|1.16|l can be established by elementary means, it is still complicated 
and its proof lacks a conceptual explanation. 

In the case of Rankin-Selberg L-functions of higher rank groups, the inte- 
grals analogous to (|1.16|l become exceedingly difficult, or even impossible, to 
compute. In fact, it is commonly believed that such integrals may not always 
be expressible in terms of Gamma fimctions T, §2.6]. If true, this would not 
contradict Langlands' prediction that the functional equations involve certain 
definite Gamma factors |1U[I11| : the functional equations pin down only the 
ratios of the Gamma factors on the two sides, which can of course be expressed 
also as ratios of other functions. 

Broadly speaking, the existing approaches to the L-functions for higher rank 
groups overcome the problem of computing these so-called archimedean integrals 
in one of two ways. Even if the integrals cannot be computed explicitly, it 
may be possible to establish a functional equation with unknown coefficients; 
it may then be possible to identify the coefficients in some special case, or by 
an analysis of their zeroes and poles. The Langlands-Shahidi method, on the 
other hand, often exhibits the functional equation with precisely the Gamma 
factors predicted by Langlands. Both methods have one difficulty in common: 
ruling out poles - other than those at the expected places - of the L-functions 
in question requires considerable effort, and is not always possible. 

We are approaching the analytic continuation and functional equation of 
L-functions from a different point of view. Instead of working with automor- 
phic forms - i.e., the higher dimensional analogues of modular forms and Maass 
forms - we attach the L-functions to automorphic distributions. In the case of 
modular forms and Maass forms, the automorphic distributions can be described 
quite concretely as boundary values. Alternatively but equivalently, they can be 
described abstractly; see §2] or section three below. Computing with distri- 
butions presents some technical difficulties. What we gain in return are explicit 
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formulas for the archimedean integrals that arise in the setting of automorphic 
distributions. This has led us to some new results. 

In the next section we show how our method works in the simplest case, 
for the standard L-functions of modular forms and Maass forms. We treat the 
Rankin-Selberg L-function in section four, following the description of our main 
analytic tool in section three. Section five, finally, is devoted to the exterior 
square i-function for GL{A,Z). That is the first not-entirely-trivial case of the 
main result of ^S] . It can be explained more transparently than the general case 
for two reasons: the main analytic tool is the pairing of distributions, which for 
GL{A) reduces to a variant of the Rankin-Selberg method for GL{2). Also, 
the general case involves a somewhat subtle induction, with G'L(4) representing 
merely the initial step. 



2 Standard L- functions for SL{2) 

Holomorphic functions on the disk or the upper half plane have hyperfunc- 
tion boundary values, essentially by definition of the notion of hyperfunction. 
Holomorphic functions of moderate growth, in particular modular forms, have 
distribution boundary values: 

t{x) = limy^o+ F{x + iy) (2.1) 

is the automorphic distribution corresponding to a modular form F for SL(2, Z), 
of weight k. The limit exists in the strong distribution topology. From the 
distribution r inherits its SL{2, Z)-automorphy property 

r{x) ^ {cx + d)-^T{^) foraU (^^)e5L(2,Z). (2.2) 

In terms of Fourier expansion of the cuspidal modular form F{z), the limit 
H2.1|l can be taken term-by-term, 

t{x) V a„e(nx). (2.3) 

We shall argue next that it makes sense to take the Mellin transform of the 
distribution t, and that this Mellin is an entire function of the variable s. The 
argument will be a special case of the techniques developed in our paper ■ 

Note that the periodic distribution r has no constant term. It can therefore 
be expressed as the €-th derivative of a continuous, periodic function (pi, for 
every sufficiently large integer ^, 

t{x) = (j)f\x), with 0£eC(M/Z) 

(2.4) 

(0^(2;) = ^ (27rm)~^ a„ e(nx) ) . 

Using the formal rule for pairing the "test function" x^^^ against the derivative 
of a distribution, we find 



X 



''^T{x)dx = / x'-^^4>i{x)dx = (-l)V Ux)^x'"^dx. (2.5) 
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As a continuous, periodic function, <j)i is bounded. That makes the expression 
on the right in (|2.5() integrable away from x ~ provided ^ > Re s. Indeed, 
if we multiply the Mellin kernel a;*^^ by a cutoff function ip G C°°(R), with 
4^{x) = 1 near a; = oo and tpi^) = near a; = 0, the resulting integral is an 
entire function of the variable s - we simply choose £ larger than the real part 
of any particular s. Increasing the value of £ further does not affect the integral, 
as can be seen by a legitimate application of integration by parts. The identity 
H2.2|l . with a = d — 0, b — —c — 1, gives 

Tix) = (-xr'^Ti-l/x), (2.6) 

so the behavior of r(x) near zero duplicates its behavior near oo, except for the 
factor {—x)'' which can be absorbed into the Mellin kernel. The expression on 
the right in H2.5I) is therefore integrable even down to zero, and 



poo 

s I— > / t{x) x''"'^ dx is a well defined, entire holomorphic function. (2.7) 

"'0 

The change of variables x t—^ 1/x and the transformation law (|2.6fl imply 

/>oo />oo 

/ t{x)x'-Ux = {^1)'' t{-x)x''-'-Ux. (2.8) 
Jo Jo 



The integral on the right is of course well defined, for the same reason as the 
integral p.7|l . 

In view of the argument we just sketched, it is entirely legitimate to re- 
place t{x) by its Fourier series and to interchange the order of integration and 
summation: for Re s 3> 0, 



poo poo 

/ T(x)x''^^dx — y ane(nx) x'^~^ dx 

Jo Jo ^">o 

pOO pC 

= a-n e(nx) x''"-^ dx = L(s-^^,F) 

^">o Jo Jo 



(2.9) 



e{x) x^ dx 



recall p. 21) . The integral on the right makes sense for Re s > if one regards 
e(x) as a distribution and applies integration by parts, as was done in the case 
of t{x). In the range < Re s < 1 it converges conditionally. This integral is 
well known, 



e{x)x''-'dx = (2Tr)-T{s)e{s/4) (0<Res<l). (2.10) 

Since T{s)e{s/A) has no zeroes, (|2.7|l and H2.9II2.10|1 imply that L(s, F) is entire. 
Replacing t{x) by t{—x) in H2.9|) has the effect of replacing e{x) by e(— a;), and 
accordingly the factor e(s/4) by e(-s/4) in H2.10|l . Thus H2.7H2.10|I imply 

(27r)-^e(./4)r(.)L(.-^,F) = 

= (-l)'=(27r)''-'=e((s-fc)/4)r(/c-s)L(l-s + ^,i^). 
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Since e(— fc/4) = this functional equation is equivalent to the functional 
equation stated in (|1.5|l . 

A Maass form is a F-invariant eigenfunction F e C°°(7i) for the hyperbolic 
Laplacian A, of moderate growth towards the boundary of Ti.. It is convenient 
to express the eigenvalue as (A^ — l)/4, so that 

+ = (2-12) 

Near the real axis, the Maass form F has an asymptotic expansion, 

F{x + iy) ~ y'^Efe>o^^-^(^)y'' + y'*^E,>o^-^-^-(^)y'' (2.13) 

as y tends to zero from above, with distribution cocfhcients T±A,fc • In the 
exceptional case A = 0, the leading terms y^^^^^^^ y(i+->')/2 jnust be replaced 
by, respectively, y^^"^ and y^/^logy. The leading coefficients 

Tx —dcf T\fl , T_A —dcf T_A,o (2-14) 

determine the others recursively. They are the automorphic distributions corre- 
sponding to the Maass form F. Each of the two also determines the other - in 
a way we shall explain later - unless A is a negative odd integer, in which case 
the T-\^k all vanish identically. To avoid making statements with trivial coun- 
terexamples, we shall not consider t_a when A G Z<o n (2Z-I- 1), and for A = 0, 
we shall only consider the coefficient of y^/^, not the coefficient of y^^^ logy. 

Unlike modular forms, Maass forms are F-invariant as functions, i.e., without 
a factor of automorphy. However, because of the nature of the asymptotic 
expansion H2.13|l . the F-invariance of -F translates into an automorphy condition 
on the automorphic distributions, 

r^{:c) = \cx + d\'-W,[^) forall (2^)eF. (2.15) 

To simplify the discussion, we suppose F = SL{2,Z), as before. Then (|2.15|) . 
with a = b = d=l, c = implies tx{x) = t>(x -t- 1), so t\ has a Fourier 
expansion 

Tx{x) = V a„e(?ix). (2.16) 

^ — ^neZ 

From the point of view of L- functions, cuspidal Maass forms are more interesting 
than non-cuspidal forms. The condition of cuspidality on F is equivalent to two 
conditions on the automorphic distribution tx, namely 

flo = , and t\ vanishes to infinite order at a; = (2-17) 

|13|. To explain the meaning of the second condition, we note that the discussion 
leading up to H2.4|l applies also in the present context, since oq = 0. The 
automorphy condition H2.15|l . with a = d — 0, & = — c=— 1, asserts 

Tx{x) = \x\^-Wx{-l/x). (2.18) 
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Combined with (|2.4|) and the chain rule for the change of variables x ^ — l/x, 
this implies 

T^{x) = \x\^-^ {x^j-Y onR-{0}, (2.19) 

for every sufficiently large ^ £ N, with some (pg E C(R — {0}) which remains 
bounded as \x\ oo. Moving the factor Ixl"^^^ across the differential operator 
and keeping track of the powers of x shows that the right hand side of H2.19|l 
defines a distribution even on a neighborhood of the origin - a distribution with 
the remarkable property that for each m G N it can be expressed, locally near 
a: = 0, as 

x™'Pm{x j^^ifimix), with -0™ defined and continuous near the origin; (2.20) 

here Pm denotes a complex polynomial, whose coefficients depend on m and A. 
In |13| we introduced the terminology vanishing to infinite order a.t x = for 
the property (|2.2U|) of a distribution defined on a neighborhood of the origin in 
R. 

To summarize the discussion so far, we have shown that a distribution tx 
satisfying the automorphy condition (|2.15|) for F — SL{2,Z), and additionally 
the condition oq — 0, agrees on R — {0} with a distribution that vanishes to 
infinite order at a; = 0. Thus either t\ itself vanishes to infinite order at x = - 
this is the meaning of the second condition in (|2.17|) , of course - or else differs 
from such a distribution by one with support at the origin. A distribution 
supported at the origin is a linear combination of the delta function and its 
derivatives, and cannot vanish to infinite order at x = unless it is identically 
zero. If, contrary to our standing hypothesis, F is a congruence subgroup of 
S'L(2,Z), the conditions H2.17|l must be imposed at each of the cusps of F. In 
that case the second condition (|2.17|) must also be stated slightly differently. 

If F{x + iy) is a Maass form, then so is F{—x + iy). It therefore makes sense 
to speak of even and odd Maass forms, i.e., Maass forms such that F{—x + iy) = 
±F{x + iy). Every Maass form can be expressed uniquely as the sum of an even 
and an odd Maass form. If F is cuspidal, then so are the even and odd parts. 
The parity of F affects the Gamma factors in the functional equation of L{s, F). 
We shall therefore suppose that F, and hence also t\, has a definite parity, 

T\{~x) = {-ly^ T),{x) , or equivalently 

a-n = (-l)''an foraUn {TjeZ/2Z). ^ ' ' 

We also suppose that F is cuspidal, so that t\ satisfies H2.17|l . As one conse- 
quence of the parity condition, the i-function 

L{s,F) = V a„n~'+^ (Res>0) (2.22) 

completely determines all the a„, and therefore also t\ and F. We had remarked 
earlier that t\ and t_a play essentially symmetric roles unless A is a negative 
odd integer or A = 0. Outside of those exceptional cases, the Fourier coefficients 
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of T\ and T-x are related by the factor of proportionality CA|n|^, with cx ^ 0. 
Switching tx and T-x has the minor effect of renormalizing the L-function 
H2.22|l by the non-zero constant cx- It is not difficult to eliminate the remaining 
ambiguity in normalizing L{s,F), but we shall not pursue the matter here. 

Arguing exactly as in the case of a modular form, we see that the signed 
Mellin transform 

M^{s,Tx) = [ Tx{x){sgnxr\xrUx (2.23) 

is a well defined entire holomorphic function. It is legitimate to substitute the 
Fourier series (|2.15|) for tx and to interchange the order of summation and 
integration, again for the same reasons as in the case of modular forms, hence 

M^{s,Tx) = 2^ a„n" / e{x) {sgnx)'^ \x\'-Ux 

^"^1 Jm (2.24) 

= 2G^(s)L(s + |,F), 

with 

G^(s) = / e(x)(sgnx)''|xf^ida; 
Jr 

the explicit formula for G^(s) follows from H2.10|l . Since Mjj{s,F) is entire, 
H2.24MT^5|) show that L{s, F) extends meromorphically to the entire s-plane. 

The change of variables a; i-^ — 1/a; in H2.23|l . combined with the transforma- 
tion rule gives the functional equation 

M^{s,Tx) = (-l)"Af„(l-5-A,rA), (2.26) 

which in turn implies the functional equation 

G„(s-|)i(s,F) = (-l)''G„(l-s-|)i(l-s,F) (2.27) 

for L(s,F). Standard Gamma identities establish the equivalence between 
Maass' version of the functional equation and (|2.27|) . 

Though we know that the product G,,(s — ■|)L(s, F) is entire, we cannot yet 
conclude that L(s, i^) is also entire: unlike r(s), Gjj{s) has zeroes. To deal with 
this problem, we consider the Fourier transform tx of the tempered distribution 
Tx- We use the normalization f{y) — f{x)e{—xy)dx. Then e{nx), considered 
as tempered distribution, has Fourier transform J-e{nx) — (5„(x) = Dirac delta 
function at a; = n, and 

rx{x) = V ^a,J„{x). (2.28) 

This distribution visibly vanishes in a neighborhood of the origin, in particular 
vanishes to infinite order at x = 0. According to ^1 theorem 3.19], the fact 



(27r)'- 



cos(2^) 



(27r)= ''"H 2 > 



if rj 
if rj 



(2.25) 
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that T\ vanishes to infinite order at a; = - cf. (|2.17|l - imphes that t\{1/x) 
extends across the origin to a distribution that vanishes there to infinite order. 
Since both t\{x) and t\{1/x) have this property, the signed MeUin transform 

MJs.Tx) = 2y a„n^"i ( Re s < ) 

^n>0 (2.29) 

^ 2L(l-s + |,F) 

is a well defined, entire holomorphic function. In other words, i(s, F) is entire, 
as was to be shown. 

The preceding argument essentially applies also to the case of modular forms, 
except that one is then dealing with automorphic distributions that are neither 
even nor odd, but have only positive Fourier coefficients. In fact, if one considers 
modular forms and Maass forms not for SL{2) but for GL{2), a single argument 
treats both types of automorphic distributions absolutely uniformly. However, 
the case of modular forms is simpler in one respect: the fact that the L-function 
has no poles requires no special argument. 



3 Pairings of automorphic distributions 

In the last section we encountered automorphic distributions as distributions 
on the real line, obtained by a limiting process. For higher rank groups, it is 
necessary to take a more abstract point of view, which wc shall now explain. 

Initially in this section G shall denote a reductive Lie group, Zq the iden- 
tity component in the center Zq of G, and F C G an arithmetically defined 
subgroup. Note that G acts unitarily on i^(F\G/ZQ), via right translation. 
We consider an irreducible unitary representation (tt, V) of G which occurs dis- 
cretely in L2(F\G/Z0 ), 

j:V ^ i2(F\G/Z°). (3.1) 

Recall the notion of a C°° vector for tt : a vector v ^ V such that g i-^ T^{g)v is 
a C°° map from G to the Hilbert space V . The space of G°° vectors C F is 
dense, G-invariant, and gets mapped to G°°(F\G/2'q) by the embedding H3.1(l . 
That makes 

T ^ T,:V'^ ^ <C, t{v) = j«(e), (3.2) 

a well defined linear map. It is F-invariant because jv E {T\G / Z^) , and is 
continuous with respect to the natural topology on V°°. One should therefore 
think of T as a F-invariant distribution vector for the dual representation (tt', V') 

- i.e., T e {{V)^°°) ■ Very importantly, r determines j completely. Indeed, j 
is G-invariant, so the defining identity (|3.2|l specifies the value of jv, v € V°°, 
not only at the identity, but at any g G G. Since V°° is dense in V, knowing 
the effect of j on V°° means knowing j. 

The space L^(F\G/Zq) is self-dual, hence if V occurs discretely, so does its 
dual V' . Since we shall be working primarily with r, we switch the roles of V 
and V' . From now on, 

T e {V-°^f (3.3) 
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shall denote a F-invariant distribution vector corresponding to a discrete embed- 
ding V ^ L^{T\G/Zq). Not all F-invariant distribution vectors correspond to 
embeddings into L'^{T\G/Zq); some correspond to Eisenstein series, and others 
not even to those. 

The arithmetically defined subgroup F is arithmetic with respect to a par- 
ticular Q-structure on G. If P C G is a parabolic subgroup, defined over Q, 
with unipotent radical U, then F H J7 is a lattice in U; in other words, the 
quotient C//(Fn U) is compact. One calls r S cuspidal if 

/ 7r(u)rdw = 0, (3.4) 

Ju/(rnu) 

for the unipotent radical U of any parabolic subgroup P that is defined over 
Q. Since there exist only finitely many F-conjugacy classes of such parabolics, 
cuspidality amounts to only finitely many conditions. Essentially by definition, 
cuspidal embeddings V ^ L'^{T\G/Zq) correspond to cuspidal distribution 
vectors t G {V^°°)^ , and conversely every cuspidal automorphic r arises from 
a cuspidal embedding of V into L^{T\G/Z^). 

To get a handle on t G {V~°°)^, we realize the space of C°° vectors V°° 
as a subspace V°° ^ V^g of the space of C°° vectors for a not-necessarily- 
unitary principal series representation {tt\^s,V\,s). The Casselman embedding 
theorem |3] guarantees the existence of such an embedding. For the moment, 
we leave the meaning of the subscripts A, S undefined. They are the parameters 
of the principal series, which we shall explain presently in the relevant cases. 
A theorem of Casselman- Wallach asserts that the inclusion V°° ^ V^g 

extends continuously to an embedding of the space of distribution vectors, 

This allows us to consider the automorphic distribution r as a distribution vector 
for a principal series representation, 

re{V,-ff. (3.6) 

When G = 5*^(2,18), cuspidal modular forms correspond to embeddings of 
discrete series representations into L^(F\G), and cuspidal Maass forms to em- 
beddings of unitary principal series or complementary series representations. 
The realization of discrete series representations of SL{2,M.) as subrepresenta- 
tions of principal series representations is very well known, making (|3.6|l quite 
concrete. For general groups, the Casselman embeddings cannot be described 
equally explicitly, nor do they need to be unique. Those are not obstacles to 
using l|3.6|) in studying i-functions. In fact, the non-uniqueness is sometimes 
helpful in ruling out poles of L- functions. 

Our tool in studying Rankin-Selberg and related L- functions is the pairing of 
automorphic distributions. In this paper, we shall only discuss Rankin-Sclberg 
L-functions for GL{2) and the exterior square L-function for GL(4). Both in- 
volve the pairing of automorphic distributions of GL(2). To minimize notational 
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effort, we shall work with the group 

G = PGL{2,R) ^ SL^{2,R)/{±1} 

( SL^{2, R) = {ge GL{2, R) \ det 5 = ±1 } ) , ^^'^^ 

rather than G = GL{2,R), for the remainder of this section. We let S c G 
denote the lower triangular subgroup. For A e C and S G Z/2Z, we define 

Xx,s:B^C*, XA,5(2^) = (sgn§)*|||^. (3.8) 

The parameterization of the principal series involves a "/O-shift", i.e., a shift by 
the half-sum of the positive roots. In our concrete setting 

p = 1, (3.9) 

and we shall write X\-p,S instead of Xa-i,<5 to be consistent with the usual 
notation in the subject. The space of C°° vectors for the principal series repre- 
sentation TTx^s is 

V^s = {F& C°°{G) I F{9b) = xx-pAb-^)F{9) for all gGG, beB } , (3.10) 
with action 

{^>.,s{g)F){h) = F{g-'h) {FeV^s, g,hGG). (3.11) 
Quite analogously 

^aT = {^eC-°°(G) I r{gb) = xx-pAb-')r{g) for all gGG, bGB} (3.12) 
is the space of distribution vectors, on which G acts by the same formula as on 

yoo 

''a,,?- 

The tautological action of GL(2,M) on induces a transitive action of 
G = PGL{2,R) on MP^ in fact MP^ ^ G/B, since B is the isotropy subgroup 
at the line spanned by the second standard basis vector of R^. According to 
the so-called "fundamental theorem of projective geometry", the action of G on 
MP^ induces a simply transitive, faithful action on the set of triples of distinct 
points in RF^ x RF^ x MP^ Put differently, G has a dense open orbit in 

MP^ X MP^ X MP^ S G/B X G/B x G/B , (3.13) 

and can be identified with that dense open orbit once a base point has been 
chosen. The three matrices 

/i = ai), h = a\), fs = (3-14) 

lie in distinct cosets of B, so 

G ^ G/Bx G/B xG/B, g^ (gf^B, 5/3B) , (3.15) 
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gives a concrete identification of G with its open orbit in RP^ X MP^ X RP\ 

Formally at least, the existence of the open orbit can be used to define a 
G-invariant trilinear pairing 

r (3.16) 

(Fi, F2, ^^3) ^ P{Fi,F2, F3) -dot / i^2(5/2) ^3(5/3) d5 , 

Jg 

between any three principal series representations. Although the G-invariance 
of the pairing is obvious from this formula, it is not clear that the integral 
converges. Before addressing the question of convergence, we should remark 
that the "fundamental theorem of projective geometry" is field- independent. 
The same ideas have been used to construct triple pairings for representations 
of PGL(2,Qp). We should also point out that a different choice of base points 
fj would have the effect of multiplying the pairing by a non-zero constant. 

The question of convergence of the integral H3.16|l is most easily understood 
in terms of the "unbounded realization" of the principal series, which we discuss 
next. The subgroup 

N = {nx-(J?) I a;eR} = M (3.17) 
of G acts freely on G/B, and its image omits only a single point, the coset of 

(3.18) 

It follows that any F G is completely determined by its restriction to = M; 
the defining identities (|3.8ll3.1l)|) imply that 4>q — restriction of F to R is related 
to (j)ao = restriction of tt\^s{s)F to R by the identity (f>oa{x) — \x\^~^(j){—l/x). 
This leads naturally to the identification 

V,^s = { e G°°(R) I \x\^-' cPi-l/x) e G°°(R) } , (3.19) 

with action 

\cx+d\ \ A-1 ;/ ax+b\ 



{-Mm = (sgn(ad-6c))°(J^)^-V(ff±^) 

for .9-1 = (?S)eG. 



(3.20) 



If (</-!, <^2,<^3) e (G°°(R))' correspond to {F^^F^.F^) e V^^^,^ x F^-,^ x F-,^ 
via the unbounded realization H3.19|l . 

P{Fi,F2,F3) = / (j)i{x)(j)2{y)(j)z{z)k{x,y,z)dxdydz , with 

kix,y,z) = sgn{{x - y){y ~ z){z - x))^'"^^^^^^ X i^-'^'^) 

-A1-A2+A3-1 , A1-A2-A3-1 -A1+A2-A3-1 

X \x — y\ 2 \y — z\ 2 Ix — z| 2 

This can be seen from the explicit form of the isomorphism 13.19|l , coupled with 
the definition H3.10|l of . We should point out that in the setting of Maass 
forms, S plays the role of the parity 77 in H2.21|l . 
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Contrary to appearance, the integral H3.21|l is really an integral over the 
compact space RP^ x MP^ x RP"'^: the integral retains the same general form 
when one or more of the coordinates x, y, z are replaced by their reciprocals; this 
follows from the behavior of the 0j at oo specified in H3.19|l . The convergence of 
the integral is therefore a purely local matter. Near points where exactly two of 
the coordinates coincide, absolute convergence is guaranteed when the real part 
of the corresponding exponent is greater than —1. To analyze the convergence 
near points of the triple diagonal {x = y — z}, it helps to "blow up" the triple 
diagonal in the sense of real algebraic geometry - or equivalently, to use polar 
coordinates in the normal directions. One then sees that absolute convergence 
requires not only the earlier condition 

Re (A, - A, - Afe) > -1 if i^j,j^k,k^i, (3.22) 

but also 

Re (Ai + A2 + A3) < 1 . (3.23) 

Both conditions certainly hold when the Vx-^St belong to the unitary principal 
series, i.e., when all the Xj are purely imaginary. 

The argument we have sketched establishes the existence of an invariant 
trilinear pairing between the spaces of C°° vectors of any three unitary principal 
series representations. The pairing is known to be unique up to scaling 
Even when the A^ are not purely imaginary, one can use l|3.21|) to exhibit an 
invariant trilinear pairing by meromorphic continuation. Indeed, for compactly 
supported functions of one variable, the functional f i—> f{x)\x\''~^dx extends 
meromorphically to s G C, with first order poles at the non-positive integers, but 
no other poles. As was just argued, the integral kernel in (|3.21|l can be expressed 
as or lul**! \v\^^ , in terms of suitable local coordinates, after blowing up when 
necessary. Localizing the problem as before, by means of a suitable partition 
of unity, one can therefore assign a meaning to the integral (|3.21|) for all triples 
(Ai, A2, A3) € C"^ outside certain hyperplanes, where the integral has poles. Even 
for parameters (Ai,A2,A3) on these hyperplanes one can exhibit an invariant 
triple pairing by taking residues. 

Let us now consider the datum of distribution vectors tj e y\ °s. for three 
principal series representations Vx.,Sj, 1 < J < 3. The unbounded realization 
of the V^~'^. is slightly more complicated than the C°° case (j3.19|l : unlike a 
C°° function, a distribution is not determined by its restriction to a dense open 
subset of its domain. The distribution analogue of H3.19|l . 

^aT - {('^c^oo) e (C-°°(R))' I a^ix) = \x\^-'aoi^l/x)] , (3.24) 

therefore involves a pair of distributions on R that determine each other on 
R — {0}. Suppose now that tj = (o-j,o, crj,oo) via H3.24|l . Then 

{x,y,z) (Ti^n{x) cr2,o{y) cr3fi{z) sgn{{x ~ y){y - z){z- x)f'^^^^^'' X 

I -A1-A2+A3+1 I A1-A2-A3+1 -A1+A2-A3+1 

X \x — y\ 2 \y — z\ 2 \x — z\ 2 
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extends naturally to a distribution on {{x,y,z) £ (RP"^) \ x ^ y ^ z ^ x}; 
as one or more of the coordinates tend to oo, one replaces those coordinates by 
the negative of their reciprocals, and simultaneously the corresponding aj^ by 
Cj^oo- Since {{x,y,z) e (MP"'^)^ \ x^y^z^x} = G via the identification 
H3.15|l . we may regard H3.25|l as a distribution on G. In fact, this distribution is 

{5 ^ n{gf,)r2{gf2)Mgh)} e C-°°(G), (3.26) 

although the latter description has no immediately obvious meaning without 
the steps we have just gone through. The apparent discrepancy between the 
signs in the exponents in (|3.21|l and H3.25|l reflects the fact that 

\x — y\^^ \y — z\^^ \z ^ x\^^ dx dy dz = dg = Haar measure on G (3.27) 

via the identification l|3.15|l . Let us formally record the substance of our discus- 
sion: 

Observation 3.28 For r, e V^.°^^ , 1 < j < 3 , 

.9 Ti{gfi)T2{gf2)T3{gf3) 

is a well defined distribution on G. 

To motivate our result on pairings of automorphic distributions, we tem- 
porarily deviate from our standing assumption that F C G be arithmetically 
defined; instead we suppose that F C G is a discrete, cocompact subgroup. In 
that case, if r, € {^)^°s )^' 1 < J < 3, are F-invariant distribution vectors, 
H3.26|l defines a distribution on the compact manifold F\G. As such, it can be 
integrated against the constant function 1, and 

/ riigh)T2{gf2)Mgh)dg (3.29) 
Jr\G 

has definite meaning. The value of the integral remains unchanged when the 
variable of integration g is replaced by gh, for any particular h € G. Thus, if 
ip G C^{G) has total integral one, 

/ Ti{gfi)T2{gf2)T3{gf3)dg = 
Jr\G 

= 11 Ti{ghfi)T2{ghf2)T3{ghf3)i^{h)dgdh (3.30) 
Jg Jr\G 

= (X ^''^^^^'^ M9hf2) Mghh) m dh^ dg . 

The implicit use of Fubini's theorem at the second step can be justified by a 
partition of unity argument. In short, we have expressed the integral (|3.29|l as 
the integral over F\G of the F-invariant function 

g ^ f nighh)T2{ghf2)Mghh)i;{h)dh. (3.31) 
Jg 
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This function is smooth, hke any convolution of a distribution with a compactly 
supported C°° function. Note that the integral H3.31|l is well defined even for 
parameters (Ai, A2, A3) € which correspond to poles of the integral H3.21|l . 

We now return to our earlier setting, of an arithmetically defined subgroup 
r C G = PGL{2,M.), specifically a congruence subgroup 

r C PGL{2,Z). (3.32) 

In this context, the integral H3.29|l has no obvious meaning, since we would have 
to integrate a distribution over the noncompact manifold T\G. The "smoothed" 
integral, however, potentially makes sense: if the integrand (|3.31|) can be shown 
to decay rapidly towards the cusps of T\G, it is simply an ordinary, convergent 
integral. That is the case, under appropriate hypotheses: 

Theorem 3.33 Let Tj e {V\ °s )^> 1 < j < 3, be T-automorphic distributions, 
and ip e C^{G) a test function, subject to the normalizing condition 

f ^{g)dg = 1. 
Jg 

If at least one of the tj is cuspidal, the T -invariant C°° function 

Fig) = / nighf,)T2ighf2)Mghf3)i;{h)dh 
Jg 

decays rapidly along the cusps of T; in particular Jp^g. F{g) dg converges abso- 
lutely. This integral does not depend on the specific choice of tp. If, in addition, 
one of the Tj depends holomorphically on a complex parameter, 

f F(g)dg ^ I I Ti{ghfi)T2{ghf2)n{9hf^)i^{h)dhdg 

JT\G JT\GJG 

also depends holomorphically on that parameter. 

Why does F decay rapidly? It is not a modular form - the Casimir operator 
of G does not act on it finitely. Nor does F satisfy the condition of cuspidality. 
However, F can be expressed as the restriction to the diagonal of a modular 
form in three variables: 

(91,52,53) / Ti{gihfi)T2{g2hf2)T3{g3hf3)ij{h)dh (3.34) 

JG 

is a C°° function on G x G x G; this follows from the fact that the cosets fjB 
lie in general position. Since Tj G i^x -^ )^: (|3.34|l is a F-invariant eigenfunction 
of the Casimir operator in each of the variables separately. It is cuspidal in the 
variable corresponding to the cuspidal factor Tj , hence decays rapidly in this one 
direction. It has at worst moderate growth in the other directions, and therefore 
decays rapidly when restricted to the diagonal. The remaining assertions of the 
lemma are relatively straightforward. 
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We shall need a variant of the theorem in the last section, for the analysis of 
the exterior square L-function for GL{4:). Two of the tj then occur coupled, as 
a distribution vector for a principal series representation of G x G, F-invariant 
only under the diagonal action, not separately. These two Tj arise from a single 
cuspidal automorphic distribution t for GL(4,M). In this situation the rapid 
decay of F reflects the cuspidality of r. 

4 The Rankin-Selberg L-function for GL{2) 

The argument we are about to sketch parallels the classical arguments of Rankin 
[T7) and Selberg ^Sli and of Jacquet |S] in the case of Maass forms. We shall 
pair two automorphic distributions against an Eisenstein series. In our setting, 
of course, the Eisenstein series is also an automorphic distribution. 

We recall the construction of the distribution Eisenstein series from |15| . 
specialized to the case of G = PGL(2,R). To simplify the discussion, we only 
work at full level - in other words, with 

r = FGL(2,Z) ~ 5i±(2,Z)/{±l}. (4.1) 

We define 600 G VJ'^ in terms of the unbounded realization 13.24|l : S^o cor- 
responds to ((To, (Too), with ao — and (Too = Dirac delta function at 0. Then 
7ri/,o(7)i5oo = Soo for all 7 € Too = {7 G F | 700 = 00}. In particular, the series 

e V-,°° , E, = + 1) E .r/r ^-.o(7)'5oo , (4.2) 

makes sense at least formally. It is F-invariant by construction. Hence, when we 
describe E^ in terms of the unbounded realization (|3.24l) . it suffices to specify 
the first member (Tq of the pair (cto,(Too)- This allows us to regard E^, as a 
distribution on the real line, 

^ E I-""-' Sp^^ix) . (4.3) 

To see the equivalence of H4.2|l and (j4.3|l . we note that (5p/g(x), with p,q £ Z 
relatively prime, corresponds to the translate of 600 under 

( g s ) e F , with r,s £ chosen so that sp — rq = 1 . (4.4) 

The disappearance of the factor ({v + 1) in (|4.3() reflects the fact that we now 
sum over all pairs of integers p, q, with q > 0, not over relatively prime pairs. 

The integral of the series (|4.3|) against a compactly supported test function 
converges uniformly and absolutely when Re > 1. Hence E^ G ^^0° ^^^^ 
defined for Re v > 1 , and depends holomorphically on v in this region. The 
periodic distribution (|4.3() has a Fourier expansion, 

~ V a„ einx) . (4.5) 
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To calculate the Fourier coefficients, we reinterpret the sum as a distribution on 
R/Z. Then 



q>Q ^0<p<q ' " ' if n = . 



= y y q-"-' e{-np/q) = 



(4.6) 



The a„, n 7^ 0, are entire functions of whereas ao = C(^) ^ pole at v — I, 
so 

El, extends meromorphically to the entire complex plane, 
with a single pole at = 1, of order one. 

We should remark that is even with respect to the involution x t—^ —x. This 
is the reason why at full level there is no Eisenstein series of odd parity - i.e., 
no Eisenstein series in . 

The Eisenstein series (|4.2ll satisfies a functional equation, which relates 
E-i, e VZ^Q to El, G via the intertwining operator 

■■ ^-To — • (4-8) 

On the level of C°° vectors, and in terms of the unbounded realization (|3.19|) . 
the operator is given by the formula 

{.hcf){x) = [ ^{y)\y-xrUy. (4.9) 

Because of the condition on cf) at infinity, this integral has no singularity at 
y — 00. At y = x, the integral converges when Rc ly > 0, but continues mero- 
morphically to the entire complex plane. It is known that the integral trans- 
form H4.9|l extends continuously from an operator J^, : V^l between 
the spaces of C°° vectors, to the operator H4.8|l . Alternatively and equivalcntly, 
1)4. 8|l can be defined as the adjoint of ■ Vf^Q VJ^, using the natural 
duality^ between VJ^ and VZ^- Either way one sees that 

VZ,'%3einx) Go{iy)\n\-'^einx) e V-^^ (n^O). (4-10) 

Here Go(j^) refers to the Gamma factor described in (|2.25() . and e{nx) is short- 
hand for the pair {e{nx), |x|^''^^e(— n/a;)) - cf. H3.24|l : the second member of 
the pair can be given a definite meaning even at the origin, using the notion of 
vanishing to infinite order that was discussed in section |21 

In view of the relation (|4.1l)|) . J^, maps the Fourier series (|4.5|l for E^i, to 
Go{v) times the corresponding series for Ei,, except possibly for the constant 
term and a distribution supported at infinity. However, no non-zero linear 

^ The duality which extends the G-invariant pairing X Vj^ ~* ^ given by integration 
over R, in terms of the unbounded realization. 
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combination of a constant function and a distribution supported at infinity can 
be F-invariant. This proves 



J,E^, ^ Gq{v)E,. (4.11) 

That is the functional equation satisfied by the Eisenstein series. The parameter 
V is natural from the point of view of representation theory. In the eventual 
application, we shall work with 

s = {v + l)l2 (4.12) 

instead. Note that v i-^ —v corresponds to s i-^- 1 — s. 

We now fix two automorphic distributions, either of which may arise from a 
modular form or a Maass form, 

nG(^.TX)'^ and r2e(F,-;%)^ (4.13) 

of which at least one is cuspidal. According to (|4.7|) and theorem 13.331 the 
integral 



Pj(Ti,r2,i?,) = / f nighh)T2{ghh)E,ighh)iPih)dhdg 
Jr\G Jo 



(4.14) 



depends meromorphically on e C, with a potential first order pole at v — 1 
but no other singularities. The subscript v is meant to emphasize the fact that 
the third argument lies in the space (V^~o°°)'", and the superscript F distinguishes 
this pairing of F-invariant distribution vectors from the pairing H3.21|l between 
spaces of C°° vectors. 

We shall derive the Rankin-Selberg functional equation from the functional 
equation (|4.11|) of the Eisenstein series. Since the latter involves the intertwining 
operator, we need to know how J^, relates P^^^ to Pj. First the analogous 
statement about the pairing for Pi G V^\g^, P2 G V^g^, P3 G Vf^^ , 

PiFi,F2,J,F3) = 
-(-1) Go(l-^) PiFuF2,F,). 

Note that P(. . . ) on the left and the right side of the equality refer to the 
pairing V^^^, x V^.s, x V.°fi ^ C, respectively V^^^, ^^Zs, x V-.,o ^ C. The 
Gamma factors Gsi- ■ ■) have the same meaning as in H2.25|l . Since both sides of 
the equality depend meromorphically on v, it suffices to establish it for values 
of in some non-empty open region. In view of H3.21|l and H4.9|l . the assertion 
H4.15|l reduces to the identity 



(sgn(,-t)(t-.)) - J _ _ _ ^ 

R (sgn(?/-z)(z-a;)) ^^^^^ 



Go(a + p) 
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with a = (— Ai + A2 — 1)/2 , /? = (Ai — A2 — l)/2 . The integral converges 
in the region Re a > , Re /3 > , Re (a+/3) < 1 . The uniqueness of the triple 
pairing ensures that H4.15|) must be correct up to a multiplicative constant. But 
then H4.15|l must also be correct, except possibly for the specific constant of 
proportionality. That constant can be pinned down in a variety of ways; see, 
for example, ^3 Lemma 4.32]. 

A partition of unity argument shows that the quantities {ti,T2, J,^E-^) 
and PE^{ti,T2, E^^) are related by the same Gamma factors as the global pair- 
ings in (|4.15|) . Combining this information with H4.11|l and the standard Gamma 
identity Gs[v)Gs{l - v) = we find 

Pl{r,,r2.E^) = 

Once we relate {ti,T2, E^) to the Rankin-Selberg L-function, this identity 
will turn out be the functional equation. 

We begin by substituting the expression H4.2|l for in H4.14|l . Initially we 
argue formally; the unfolding step will be justified later, when we see that the 
resulting integral converges absolutely: 



P^{r,,T2,E,) = f f T^{9hf^)T2{ghf2)E,{ghh)^{h)dhdg 
Jr\G JG 

= C{v + 1)^ ^jji{ghfi)T2{ghf2)5oo{l~'^9hh)i^{h,)dhdg (^^^^^ 



= a^ + l) / T^{ghh)T2{ghf2)6oo{9hh)Hh)dhdg. 

JT^\G JG 

The integrand for the outer integral on the right is no longer F-invariant, but it 
is (rn A^)-invariant, of course, and has all the other properties of the integrand in 
H4.14|l . Those are the properties used in the proof of theorem 13. 331 to establish 
rapid decay. In other words, the same argument shows that the integrand 
in H4.18|l decays rapidly in the direction of the cusp. However, roo\G is not 
"compact in the directions opposite to the cusp" , and we still need to argue 
that the integral converges in those directions as well. 

Together with the upper triangular unipotent subgroup N <Z G, the two 
subgroups 

K = SO{2)/{±l}, A = {a* = ('^J^o,) I teR} (4.19) 

determine the Iwasawa decomposition 

G° = NAK (4.20) 

of the identity component ~ 5*^(2, ]R)/{±1} of G. Since V.^ meets both 
components of G, and since Vrx, C^G^ —T N , we can make the identification 
roo\G ~ (r n N)\G^. Hence, and because 

dg = e^^P {a)dndadk, with eP{at) = e* , (4.21) 
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the identity (|4.18|) can be rewritten as 



= Cii^ + l) [ [ [ [ e-^Pia)ri{nakhfi)T2{nakhf2) X (4.22) 

Jk J a J(rnN)\N Jg 

X 5oo{nakhf^)ip{h)dhdndadk . 

As the t tends to +00, the point g = natk moves towards the cusp. In the 
opposite direction, as t — > —00, the integrand in (|4.22() grows at most hke a 
power of e~*. To see this, and to determine the rate of growth or decay, we 
temporarily regard the three instances of the argument nak as independent 
of each other, as in the discussion around (|3.34|) . In the case of the r,, the 
maximum rate of growth is e'-~l^° ^il+i)*^ and in the case of Soo, it is e^^'' "^+1)*^ 
without absolute value sign around Re v. The reason for the latter assertion 
is that we know the behavior of ^00(5) when g is multiplied on the left by any 
n € N - unchanged - and when g is multiplied on the left by any at € A — 
by the factor e(^° cf. below. In short, the integrand in can 

be made to decay as t — > — cx) by choosing Re v large enough. That makes the 
integral converge absolutely and justifies the unfolding process. 

The smoothing function ip G C^{G) in theorem 13.331 is arbitrary so far, 
except for the normalization rp(g)dg = 1. We can therefore require "0 to have 
support in G*^, and also impose the condition 

^{kg) = ^{g) for all fc G JsT, 5 G G ; (4.23) 

the latter can be arranged by averaging the original function ^ over K . The 
analogue of H4.21|l for the KAN decomposition is dg = e^''(a) dkdadn. Hence 

e'^P{a) ip{an) dnda = 1, or equivalently / ?/j^(a)(ia — 1, 

AJN f f ^^-^^^ 

with V'A(a) = 6^''(o) / ^^{an) dn — / ^{na)dn, 



J N J N 

restates the normalization condition for the if- invariant function ij). 

We had argued earlier that the function e{£x), for £ ^ Q, has a canonical 
extension - now viewed as distribution - across infinity. That allows us to regard 
e{£x) as a well defined element of the unbounded model (|3.24|l . We can also 
make sense of the constant function 1 as element of the unbounded model for 
Re A > 0, and for other values of A by meromorphic continuation. Whether 
or not £ equals zero, we let Bi^\,s G ^xs° denote the distribution vector that 
corresponds to e{£x). Then 

7^A,5(?^^^)S^,A,^ = e(~£x) Bi^x,s , and Bi^x,s{^x) = e{£x) . (4.25) 

The latter equation has meaning since N C G/B is open and Bi^x s, like any 
vector in V^^, transforms according to a character under right translation by 



21 



elements of B. We had assumed that at least one among ti and T2 is cuspidal - 
Ti, say, for definiteness. Then 



n = J2e=io"''^^'^'^^'^^ ' 5Ifgz^^^^^-^2,52 + ■•■ (4-26) 

are the Fourier expansions of ri and T2. Here . . . stands for a vector in V^^°^^ 
that is A^-invariant and supported on sB C G/B; recall H3.18|l for the definition 
of s € G. The scries for ti has no such singular contribution on sB, as was 
explained in H2.17|l and the passage that follows it. 

In (|4.22|l . the process of averaging over r\roo from the left and smoothing 
from the right commute. Thus, using the fact that 600 and ... in (|4.2(j|) are 
TV-invariant, we find 



{rnN)\N Jg 



(4.27) 



Ti[nakhfi) T2{nakhf2) 5oc{nakhf'i) ij^ih) dhdn = 
= ^flffo-W Bt^Xi.sA°-^^fi)B-iMMi"-^hh)5oa{akhJ:i)ip{h)dh 

= '^agb^i Bg^Xi,Si{ahfi) B^i^x2,S2{a.hf2) Soo{ahf3)'ip{h) dh 

= '^aeb^e Bi^x^^Siiah) B^i^x2,S2{ahni)Soo{ahs)ip{h)dh; 

at the second step we have used the if-invariance of ijj, and at the last step, we 
have inserted the concrete values fi — e, f2 — ni, = s - cf. H3.14|l and (|3.17fl . 

When we substitute H4.27|l into (|4.22() . we can make several simplifications. 
The expression on the right in (|4.27() no longer depends on the variable k, so the 
integral over K in l|4.22(l can be omitted. The distribution Soo is supported on 
sB C G. Hence, when the variable h in l|4.22|l is written as h ~ knd, with k E K, 
n G N, d £ A, and dh = dkdndd, the fc-integration reduces to evaluation at 
k = e. Since A acts via e^'' on the cotangent space at sB e G/B, 

5oo{aks)dk ^ e^''{a)5oo{ksa^^)dk = Xu+p{a)Soo{ks)dk for aEA. (4.28) 

It follows that Sociahs) dk = Sooiaknas) dk = doc{aks{s^^ns)d~^) dk contributes 
the factor Xiy+pi^) Xiy-pi^) = e~^''(a) Xi/+p(aa) when it is integrated over K. 
Effectively we have replaced the integrals over ft, e G in (|4.22|) and (|4.27|l by 
integrals over NA. But the integrand being smoothed in H4.27|l is already A^- 
invariant. Thus, instead of smoothing over G with respect to ijj, we only need 
to smooth over A with respect to ipA, as defined in (|4.24|) : 



i^Q JaJa (4.29) 

X i?£,Ai,5i(aa) B-^i^x^A^iO'O.ni) Xv+p{ad) V'A(a) ddda . 
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We parametrize a, a £ A as a — at, a — , as in H4.19|l . with t,i £ M. and 
da = dt, da — dt. Then, in view of the definition (jXlH) of V^^ and the 
characterization (|4.25|) of Bi^x.s, 



This leads to the equation 

g(.+i-Ai-A2)(t+t) e(_^e2(*+*)) VA(at) dtdt . 



(4.30) 



(4.31) 



To simphfy this expression further, we set a; = e^*, y = e^*, and 

V'Ala*) = My) (2/ = e'*). (4.32) 
Then dx — 2e^*c?i, = 2e^*dt, and the normahzation (|4.24|) becomes 

r Mv)- = 2. (4.33) 
Jo V 

Putting all the pieces together, we find 

= ^- — '-}^aih-i / (xy) 2 e(-^xy)i/'R(2/)^ — . ^ > 

^ ^_^Q Jo "'o y ^ 

We know from the derivation of this formula that the integral and the sum must 
converge for Re 3> 0, and indeed they do. Since the smoothing function V'r 
has compact support in (0, oo), the inner integral is the Fourier transform of a 
compactly supported C°° function on R. The resulting function of x is smooth 
at the origin and decays rapidly at infinity. That makes the outer integral 
converge, provided Re v is large enough. A change of variables then shows that 
the double integral has order of growth 0(|£|J^''(-^i+^2-i^-i)/2^^ gQ ^-j^g g^j^ does 
converge, again for Re v ^ Q. 

If we regard e(— fe), ^ ^ Q, not as a function, but as a distribution that 
vanishes to infinite order at infinity, the integral e{—£x) x~ ^ ~ dx con- 
verges for Re 0, and the smoothing process in (|4.34() becomes unnecessary. 
Taking this approach, we make the change of variables x i—f x/y, which splits 
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off the integral (|4.33|) . Hence 
Pj(ri,T2,S.) = 
= — '-y^aeb^e x ^ e{-lx) — 



= -^-^5 — -y^aib_i\t\ 2 / X 2 e(-(sgn^)a;) — ^ 

= 2^ aib_i\e\ 2 ^ x" 2 e{~{sgn£)x) — . 

At the last step, we have expressed v in terms of s, as in H4.12|l . 

By definition, the Rankin-Selberg L-function of the pair of automorphic 
distributions ti, T2 is 

L{s,Ti®T2) = C(2s)V a„6„n^4^-^ (4.36) 

^ — ^n>0 

Recall that the Fourier coefficients a„ , 6„ depend on the choice of the embedding 
parameter over — . The standard L- function (|2.22|) . and (|1.2|) in the case 
of modular forms, with A = 1 — k, are defined in terms of the renormalized 
coefficients a„|n|^/^. For the same reason the renormalized coefficients appear 
in the Rankin-Selberg L-function. To make the connection between H4.35|l and 
the L-function, notice that translation by the matrix 

r^(V!) (4.37) 

transforms Tj € (^a T realized as 7^(2;) in terms of the unbounded model, 
to {~lY^ Tj{—x). Since r e F, that means Tj{—x) = (— l)*^rj(a;), i.e., 

a_„ = (-1)^1 a„, 6_„ = (-1)*^6„. (4.38) 

Hence 

This allows us to re-write H4.35II as 

2PI^{ti,T2,E„) = L{s,Tl(g)T2) X 

X \{-lY^r 1^1-^ eix) - + {-l)'^r\xr'^ e{x) -} (4.40) 

I J-QO ^ Jo ^ J 



(4.39) 



recall (I2.25() . and also the relationship v = 2s — 1 between v and s. 

To complete the proof of the functional equation, we combine (I4.40|l with 
H4.17|l and appeal to the standard Gamma identity Gs{s)Gs{l — s) = (— 1)*^: 



24 



Proposition 4.41 The Rankin- Selberg L-function satisfies the functional equa- 
tion 

L{1- s,Ti<g)T2) = TT ^ Gs^+s^{s-\-ei^+e2^)L{s,Ti(g>T2). 

,£2 — i 1 

We have shown that l|4.4()(l has a holomorphic continuation to C — {!}, 
with at most a simple pole at s = 1. Traditionally one states the functional 
equation and analytic continuation not for the expression in H4.40|l . but rather 
for Langlands' completed i-function 

A{s,Tl(E)T2) = L^{s,Tl®T2)L{s,Tl(E)T2) , (4.42) 

whose "component at infinity" is a product of Gamma factors that depend on 
the type of the Tj. If both ri and T2 correspond to Maass forms, then 

Maass case: Loo(s, n = TT rR(s + ei^J- + + ?7) , 

J--«-£i,£2=±i (4.43) 

with 77 e {0, 1} , r] = 61+62 (mod 2) . 

Here Fk denotes the Artin F-factor 7r~''/^F(s/2). If one of the tj, say T2 for 
definiteness, corresponds to a holomorphic cusp form of weight k, then 

mixed case: Loo{s, n (g) T2) = rc(s + ^ + ^) rc(s - ^ + ^) , (4.44) 

where Fc(s) = 2(27r)~''F(s). Finally, when both ri and T2 correspond to holo- 
morphic cusp forms, of weights ki and ^2, respectively, 

modular forms case: Loo(s, n (g)T2) = Fc(s+ - l)Fc(s+ i^i^). (4.45) 

In all cases, the functional equation of the previous proposition directly implies 
the equality of A(s, n (8) T2) and A(l — s, ri (g) T2), up to a sign; this follows from 
standard Gamma identities, in particular the identity Gs{s)Gs{l — s) = (— 1)'^ 
and the Legendre duplication formula. 

Just as important as the functional equation is the assertion of holomorphy: 
both L{s,Ti (X) T2) and A(s,ri (g) T2) are holomorphic except for potential first 
order poles at s = and s — 1. For the uncompleted L-function this follows 
from a classical argument of Jacquet Lemma 14.7.5]. His argument does not 
require any detailed calculations, and holds in great generality. 

Once L{s, n (g) T2) is known to be holomorphic on C — {0, 1}, one can deduce 
the holomorphy of A(s,ri (g T2) on C — {0, 1} from the results of this section, 
as follows. Because of the functional equation, it suffices to rule out poles in 
the region {Re s > 1/2, s ^ 1}. In effect, we must show that all poles of 
Loc{s,Ti(^T2) with Re s > 1/2 are compensated by zeroes oi L{s , ti T2) . This 
is an issue only in the Maass case: modular forms have weights at least 2, and 
the parameter A of a Maass form necessarily lies in the region { |Re A| < 1/2 }. 
In the Maass case, only one of the four Gamma factors in H4.43|l can have a 
pole with Re s > 1/2. Maass forms correspond to irreducible principal series 
representations, which involve Xj and —Xj symmetrically. We can therefore 
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assume that Re Xj > 0, in which case the pole can only come from the factor 
^mis - ^^4^)' ^it^^ V = 0, and must occur at s = But then i5i = 62, 

and G5,+S2 {s - ^^^) ^Go{s- ^^l±A2 ) also has a pole at s = We know 

that (|4.4U|) is holomorphic on C — {0, 1}, thus forcing L{s, ti (g) T2) to vanish at 
s = ^J^^, as was to be shown. 

5 Exterior Square on GL(4) 

Recall that if F is a Hecke eigenform on GL{n, 'Z)\GL{n, R), or more generally, 
on the quotient of GL{n, R) by a congruence subgroup, the standard L-function 
of F has an Euler product 

^(^'^) = u,]X=^^ - ^p^^p^^y'- (5-1) 

The exterior square L-function is then defined as an Euler product 

L{s,F,Ext^) = Yl Lp{s,F,Ext^) , (5.2) 

whose factor at any unramified prime p equals 

Lpis,F,Ext') = ni<,<fe<„ (1 - "p.J^J'.fe^^"')"'- (5.3) 

The appropriate definition of the factors Lp(s,F,Ext^) corresponding to the 
finitely many ramified primes is still a subtle issue. Harris and Taylor recently 
exhibited local factors for the ramified primes that are consistent with Langlands 
functoriality principles, in their proof of the local Langlands conjectures for 
GL{n). However, Shahidi had much earlier given a separate definition, which 
by all expectations agrees with the one provided by Harris- Taylor, though the 
agreement of the two definitions is not obvious. Shahidi furthermore proved that 
the L-function with his definition of the ramified factors satisfies a functional 
equation of the type Langlands predicted. Since there can only be one definition 
which obeys this functional equation, the potential discrepancy between the 
Harris- Taylor and Shahidi definitions poses no problem from the point of view of 
L- functions, though it still is a problem for the group-theoretic definition of the 
Langlands conjectures. In any case, an argument which produces the analytic 
continuation and functional equation of L{s,F,Ext^) must give a definition 
which agrees with Shahidi's. 

In our paper ^j, we carry out the archimedean analysis of the exterior 
square L-function for GL{n); we establish the holomorphy of the partial L- 
function Ls{s, F, ExP) and its completion at infinity As{s, F, Ext'^), in both 
cases with the factors in (15.211 corresponding to the set S of ramified primes 
omitted. To keep the discussion simple, we avoid the problem of ramification in 
the present paper by treating only the full level subgroup GL(4, Z) C G'L(4,R). 

By necessity, the notation in this section will not completely agree with that 
of the earlier sections; in particular, we now set 

G = G'L(4,R), Go = 5L±(2,R), F = GL(4,Z), To = 5L±(2,Z). (5.4) 
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We shall also work with the subgroups 



U 



91 
.92 

7 
7 



51, 52 e Gi(2, 
7 e Gi(2,Z 

U e M2X2 



1 u 
1 



c G, 

c r, (5.5) 
c G. 

Gi(2,Z), but not as an 



Note that Gi ~ Gi(2,M) x GL(2,R) contains Ti 
arithmetic subgroup. 

Again we let B C G denote the lower triangular Borel subgroup, and we 
define Bi = GiD B. Each pair 



determines a character : i? C*, 

XM,';(a»j) = ni<,<4 ('^g^"^*)''' ' 

and by restriction also a character : i?i ^ C*. For G = GL(4,] 

P V 2 ' 2 ' 2 ' 2 / 

represents the half sum of the positive roots. In analogy to (|3.12|) . 



(5.6) 



(5.7) 



(5.8) 



W-^ = {rGG-°°(G) I r(56) = X,.-p,,(&"') ^(5) for all geG, (5.9) 

is the space of distribution vectors for a generic principal series representation 
of G. Principal series representations of Gi ~ GL(2,R) x GL(2,IR) are induced 
from and hence also parameterized by pairs (/^,?7) e C*x (Z/2Z)'*, 



{r e C-°° (Gi ) I T{gh) = Xm-p,. V(5) for all 5 e Gi , G Si} 



(5.10) 



Our current use of the notation is not consistent with (|3.12|) . Not only 

is Gi a product of two copies of GL(2,R), but the representations we consider 
need not be trivial on the center of Gi(2,R), in contrast to the situation in 
section 13 where we considered only automorphic distributions for PGL{2,R). 
However, the p-shift in (|5.10l) is consistent with (|3.12l) : the quantity p defined 
in H5.8|) restricts to the corresponding quantities for the two factors of Gi ~ 
Gi(2,M) X GL(2,R). 

The arithmetic group F intersects U ~ R"' in a lattice, so (F fl U)\U is 
compact. That makes it possible to define the operator 



A : (W, 



l-i,V I 



t(u 5) e(— tr u) du ( 5 G Gi ) . 



(5.11) 



{rnu)\u 
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What matters is the fact that the U ■ Gi-orbit of the identity coset in G/B is 
open. One can therefore restrict any r € (W^^) to this open subset, and then 
further to Gi, once the dependence on the variable u € U has been smoothed 
out by taking a single Fourier component. The restriction to Gi still transforms 
according to under right translation by elements of i?i = Gi O B. This 
makes At lie in V~^. Conjugation by any 7 G Fi preserves the character 
u i~+ e(— tru) of U and the lattice T D U. Since Fi C F, the F-invariance of r 
ensures the Fi-invariance of At. 

We now consider a particular cuspidal t S {W~J^)^ . Since F contains the 
center of S'L^(4,]R), any such t must vanish identically unless 

We shall also suppose that 

This is not a serious restriction: it holds automatically when r arises from a 
discrete summand of L'^{T\G/Zq), as in (|3.1() . Even when that is not the case, 
we can make (|5.13|l hold by twisting r with an appropriate character of Zq, 
without destroying the F-invariance. 

In section|31 we described the pairing of three PGi(2, Z)-automorphic dis- 
tributions on PGL(2,R). By limiting ourselves to the case of PGi(2,M) we 
avoided some notational complications in (|3.21() and 13.24|l . without essential 
loss of generality: in the case of full level, —1 e GL{2, Z) must act trivially on 
any automorphic distribution. In the current setting, we do need the pairing for 
triples of automorphic distributions on GL{2, M). Theorem l3.33l remains correct 
as stated in this more general situation, provided the integration is performed 
over SL^{2,'Z)\SL^{2,M.) - the center of GL(2,R) is noncompact and remains 
noncompact even modulo Gi(2,Z). The statement requires the F-invariance of 
all three of the arguments Tj of the pairing P. Formally, at least, invariance 
under the diagonal action of F on the three arguments suffices to produce a 
F-invariant integrand for the outer integral in theorem 13.331 It is the proof of 
rapid decay that forces us to assume F-invariance of each factor. In the present 
setting. At arises from a cuspidal automorphic distribution r on Gi(4, M). It is 
not difhcult to adapt the proof of theorem l3.33l to this case: after smoothing by 
some tp G G^(Go), the product of At with the Eisenstein series E^, does decay 
rapidly along the cusp. 

We again define the Eisenstein series E^, by the formula (|4.2|) . but now 
summing over Fo/(Fo)oo; since — 1 G (Fo)oo, (|4.5H4.7() remain correct. We 
should remark that the pairing of three automorphic distributions on GL(2,W) 
vanishes identically unless —1 G GL(2,R) acts trivially under the diagonal 
action. The parity condition H5.12(l implies that —1 acts trivially under the 
diagonal action on At. But —1 also acts trivially on delta function Sa^, and 
hence on the Eisenstein series E^,. In short, the parity condition imposed by 
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the action of the center is satisfied in our situation. We have assembled all 
ingredients to make sense of 



rn\Go Gq 



A- 



ghfi 
ghfo 



E,{ghf3)tlj{h)dhdg. (5.14) 



As a function of v this is holomorphic, except for a potential first order pole at 
u — I. What we said in section |21 about the intertwining operator and its 
interaction with the pairing remains valid, except for the parity subscripts of 
the Gamma factors in H4.15|l and 14.17|l . since we now work on GL(2,R). The 
roles of Ai and A2 are played by, respectively, /ii — and pt^ — ^4, as can be 
seen by comparing the definition H5.1()|l of to the definition H3.12|l . Thus, 

and because of (|5.13|) . Ai.^^ corresponds to ni + /i4 and ^2-^^ corresponds to 
+ Ma ■ This explains the arguments of the Gamma factors in the identity 



P^"iAT,E,) = (-1 



X G 



V1+V4 



(5.15) 



which takes the place of H4.17|l in the current setting. In the special case when 
771 — 772 and ri3 = ri4 - i.e, when the action of Gi = Gi(2,R) x Gi(2,R) on 
At drops to PGi(2,R) x PGL(2,R) - ifTT^Il agrees with in (|TT7|) . as it must. 
In the remaining cases the identity is deduced from the appropriate variant of 
(UISIl; for details see [T3]. 

The identity (|5.15ll is the source of the functional equation of the exterior 
square L-function, just as H4.17|l was the source of the functional equation for 
the Rankin-Selberg L-function L{s,ti T2). To make the connection between 
the identity H5.15() and the exterior square L-function, we need to consider the 
Fourier expansion of r on 
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til 


V X 




n{x, u, v) — 




1 




1 








\ 











u e 



(5.16) 



Since the A^-orbit through the identity coset in G/B is open, it is legitimate to 
restrict r to N. This restriction is (F n A^)-invariant, which allows us to regard 
r as lying in G^°°((F n 7V)\7V). Every (F n A^)-invariant smooth function on 
N, and dually every (F n iV)-invariant distribution, has a Fourier expansion 
with components indexed by - roughly speaking - the irreducible unitary rep- 
resentations of N. For the one dimensional, or abelian, representations this is 
literally true, but typically infinite dimensional representation contribute more 
than once, but finitely often. The non-abelian Fourier components will turn out 
not to matter for our purposes. Thus we write 



(5.17) 



with 



a 



denoting the sum of the non-abelian Fourier components of t. The 
ni,n2,n3 with positivc indiccs rij determine all the others: 



a, 



eini,e2n2,«3n3 



_ ')l ^Vl+V2 ,'7l+')2+i;3 



ni,n2.n3 



(e.G{±l}). 



(5.18) 
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Indeed, r is invariant under the action of all diagonal matrices with entries ±1, 
since F contains these. Each of them acts on N by conjugation, which has the 
effect of reversing the signs of some of the coordinates. One can then use (|5.7|l 
to determine how the a„j.„2^„3 change when the signs of one or more of the 
indices is flipped. 

When r is a Hecke eigendistribution, the Fourier coefficients an-i,n2,n3 are 
related to the Hecke eigenvalues. Specifically, k'^^'^'^^ai^k,! is the eigenvalue 
of the Hecke operator Ti^k,i- The eigenvalues for Hecke operators indexed by 
unramified primes can be expressed in terms of the a^-.p in (|5.1|) [20] . Jacquet and 
Shalika [7| §2] have used this expression to identify the factors Lp{s, t, Ext^) for 
unramified primes p in terms of the Hecke eigenvalues - in complete generality 
for all n, not just n — 4. In the case of GL(4), 

Lp{3,T,Ext') = (l-p-2^)-i^^^^ai,,.,i/(^^+^-^). (5.19) 

At full level, when there are no ramified primes, the Euler product of the local 
factors for all primes, as in (|5.2|) . expresses the exterior square i-function as 

L{s,T,Ext^) = C(2s)y" al.„,ln^l+^^~^ (5.20) 

One can use this as the definition of the exterior square L-function whether or 
not T is a Hecke eigendistribution. 

Lemma 5.21 When s and v are related by the equation 2s = v + 1, 

Pl° [At, E,) = 2 (-1)"^ G^,+„, (s - - ^2) Grn+n, (« - Mi - Ma) L{s, r, Ext^) . 

Since the proof is lengthy, we shall first deduce the functional equation, 
which follows from the lemma in combination with (|5.I5|) , H5.I2[]^T^ , and the 
standard Gamma identity Gs{s)Gs{l — s) = (—1)'': 

Proposition 5.22 i(I - s, T, iJxi^) = H Grj^+^^{s ~ fii — fXj) L{s,t, Ext'^). 

l<i<j<4 

This result is originally due to Kim ^ and, in the special case when W^^,, 
belongs to the spherical principal series, to Stade [21] ■ We refer the reader to 
our paper [^ for a discussion of the history of the exterior square L-function 
for GL{n). 

The usual statement of functional equation relates the exterior square L- 
function L{s,t, Ext'^) for GL{n) to that of the dual automorphic distribution 
T. In our case, with G = GL(4,]R), these two L-functions coincide; that makes 
it possible to state the functional equation without reference to r. 

Just as in the case of the Rankin-Selberg L-function for GL{2), Jacquet's 
general argument implies that L(s,t, Ext'^) is holomorphic, except for possible 
first order poles at s = and s — 1 [T5]. The fact that P^°{At, E^) is holomor- 
phic, together with an analysis of the poles and zeros of the Gamma factors, 
establishes the holomorphy of the completed exterior square L-function, again 
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with the possible exception of first order poles at and 1. We conclude our 
paper with the proof of the lemma. 



Proof of Lemma \5.21\ Recall the notational conventions H5.4|l ; in particular 
Gl = SL{2,M.) denotes the identity component of Go = SL^{2,M). We shall 
suppose that the smoothing function is supported on Gq, as we did in section 
01 We also impose the if-invariance condition 14.23|l and define ipA as we did 
in (|4.24|) . In section Owe had pointed out that the expression (|3.34|l is smooth 
as function of all three variables. For the same reason 

(3i,52,.93) ^ j^^^AT(^'-'^f\Xh)^oo{93hf3)i^{h)dh (5.23) 

is a C°° function on Go x Go x Gq. It is also an eigenfunction of the Casimir 
operator in each of the three variables, of moderate growth since t and S^c are 
distribution vectors. The cuspidality of r implies that the restriction of this 
function to the triple diagonal decays rapidly in the cuspidal directions. We can 
therefore set gi — g2 — 93 — 9 and integrate with respect to g over the quotient 

ro,oo\Go, with rp^oo = {7 £ To I 700 = 00}. 

In analogy with H4.18|l . we insert the definition (|4.2|l of into (|5.14l) and 
unfold: for Re ^ 0, 

Pj" {At, E,) ^ C(^ + 1) / / Ari^^'f ) Soo{9hf3mh)dh dg , (5.24) 

The justification of this step hinges on two facts. First of all, the function H5.23|l 
has moderate growth, as was just pointed out Secondly, we know the behavior 
of Sao under left translation by elements of A. From here on we can justify 
the unfolding exactly as in section 0] In H5.24|l we can replace Go in the inner 
integral by the identity component Gg on which tp is supported. Since Tq ^o 
meets both connected components of Go, we can also replace Gq by Gq in the 
outer integral, provided we simultaneously replace Fq^oo by Fq = Fq 00 n Gq. 
We parameterize Gq by the Iwasawa decomposition g = Uxuk - recall (|3.17|l and 
H4.20l{T!^T|) . To avoid confusion, we now let A^o, ^o, Kq denote the subgroups of 
G[5 = 5i(2,R) analogous to N, A, K in sections El and H Note that Fn A'^o has 
index 2 in Fg which also contains —1, so (F n Nq)\NqAqKq covers Fg oo\Gg 
twice. Thus 

Pj°(Ar,^,) = 2C(i^ + l) X 



e 

Gq 



'(a) AT(^""g''-'' n^ah/a) 5oo{nxahf:i)%lj{h)dhdxda; 



we have legitimately omitted the integration over the Iwasawa component k 
because is ii'- invariant. 

Recall the definition H5.11I) of At. It will be convenient to replace r by r°, 
defined by the formula 

T\g) ^ j T{ng)dn ^ [\((\\\i]g\dv, (5.26) 
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with Z]\j — center of N. Then is invariant under left translation by elements 
of Zpf, and by elements of F n A^. We shall also need to know that 



T°{s2,3g) = T"{g) for aU g e G, with §2,3 = 



1000 
0010 
0100 
0001 



(5.27) 



Indeed, S2,3 is contained in T and commutes with the one parameter group 
over which r is averaged to produce r°. The passage from r° to At involves 
averaging over three more variables, 
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(5.28) 



(5.29) 



the equations H5.25H5.26)) and (|5.28|) imply 



e"2''(a)e(-ui 
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f ahfi \ 

U2) 5ao{nxO'hf'i) ^p{h) dx2 dui du2 dh dx da 



(5.30) 



We appeal to the invariance of r" under the center of N to justify setting the 
(1, 4)-entry of the first matrix in the argument of r° equal to zero. 

The variable of integration x occurs three times in (|5.3Uf) . Since 600 is Nq- 
invariant, we may as well drop the factor rix in its argument. When we omit 
the integration with respect to x and treat the remaining instances of x as two 
separate variables, the integrand ~ after averaging over R'^/Z'^ and smoothing 
with respect to -0 - is a G°° function of those two variables; this follows from the 
fact that H5.23|l is separately smooth in all three arguments. We can therefore 
replace the single integral with respect to x by a double integral, provided we 
multiply the integrand by the delta function, evaluated on the difference of the 
two variables. Since 
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modulo the center of N, the integrand in (|5.3U|) is separately periodic when the 
remaining instances of the variable x are uncoupled. The sum 



Soixi-xs) = e{e{xi - X3)) 



(5.32) 



represents the "delta function along the diagonal" in M^/Z^. Thus, in view of 
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1x1 til 0\/l000 
of I 1 0«2W01a;2 
00 iKsjlOOlO 
00 l/\0001 



(5.33) 



what we just said, 

PI'>{At,E,) ^ 2av + l)Y, [ [ [ [ e{e{xi-X3))x 

JAo JR^ IT?JgI JWjT? 

X e(— ui — W2) SooiO'hfs) ipih) dx2 dui du2 dh dxi dx^ da . 
We use the matrix identity 

1000\/l^ifi0\/i0 0\ /I 2^1 ui-lxi \ / 1 
01^01(01 0«2 1(01 3:2 0\_f01 112+^2:31 ( 1 X2+t 
0010)l00 1x3)l0010)~l00 1 X3 \ 1 
OOOl/VoOOl/VOOOl/ \oo 1 / Voo 1 

the (r n A^)-invariance of r", and the change of variables ui ui + £xi, 
U2 ^ U2 — ix3 to ehminate the factor e[i{xi — X3)) in (|5.33|l while simultane- 
ously replacing X2 by X2 +i. We then combine the a;2-integral over {0 < 2:2 < 1} 
with the sum over i into a single integral over R : 

•Ixitti \ /lOOO 



(5.34) 
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_0 f f 1 «2 W 1 y W ahfi \\ ,^ ocrN 
^UOO Ixailooioll ah/2 i ) [ty.6t)) 

vvoooi/Voooi/^ 



X e~^''(a) e{—ui — U2) ^00(0^/3) V'(^) dui du2 dy dhdxi dxs da . 

The symbol y instead of X2 is meant to emphasize the new role of this variable. 

Recall the invariance of under S2.3, as defined in (|5.27() . Conjugating 32,3 
across the first matrix in the argument of has the effect of switching the roles 
of the Xi and the Uj , 
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f f 1 «2 
1 X 
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X e^'^''(a) e{—xi — X3) 5oo{ahf^) ^{h) dxi dxz dydhdui du2 da 

The congruence 
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modulo the center of N implies that we can view the integral with respect to 
dui du2 as projecting to the trivial Fourier components with respect to those 
two variables, whereas the other integrations operate from the right. Right 
translation commutes with projection onto the trivial Fourier components, thus 
allowing us to shift the integration with respect to dui du2 all the way to the 
inside. The passage from r to r° already involves a projection. Together with 
the dui du2-integral, this gives us the projection 



Tabolian, Tabelianls) = / T[ng)dn, (5.38) 

/(rn[Jv,Jv])\Af 
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onto the sum of the abehan Fourier coefRcients - equivalently of invariants for 
the derived group [N, N] C N. Thus H5.37|l reduces to 




X e '^P{a) e{—Xi — X3) Soo{ahf3) ip{h) dxi dx^ dy dhda . 



Now we argue as we did in the passage from (|4.27|) to H4.35|l . First we 
substitute e, ni, s for /i, /2, /a as in H3.14|l . We then parameterize h £ Gq as 
h = fcanj, and observe that the argument of Soa must he in NoAos{±l} to give 
a non-zero contribution. At this point the argument diverges shghtly from our 
earher argument, where we worked modulo the center of SL{2,M.). There are 
three instances of the variable h in H5.39|l . When h is replaced by (— 1) • /i, Soo 
remains unchanged, and the other two instances of h effect a hypothetical sign 
change of {-l)vi+n2+m+m _ hypothetical only since Ei<j<4^i = 0; cf- 
Thus k — e and fc = — 1 contribute equally, in effect doubling the factor 2 in 
(En3l- Since 

OX/lxiO o\/iooo\ 

5i/) ( 1 ) ( 1 a I (5.40) 
1/ \o 1/ Voooi/ 

modulo a left factor lying in [N, N] , the variable rix can simply be absorbed 
into the dxi dxa-integration. We can therefore replace dh by ipAid) da and 
the other instances of h by a, as in (|4.29l) . The smoothing by -0 has now been 
replaced by smoothing with respect to "tpA, in the single variable a. This reflects 
the fact that the A-direction is the only non-compact direction for the integral 
H5.30|l . aside from the smoothing integral over /i e Gq, of course^. Just as in 
section 0] the smoothing in the variable a will turn out to be unnecessary when 
we interpret the integrand ~ in effect, a Fourier series in one variable, without 
constant term - as a distribution which can be made convergent by integration 
by parts, under our standing assumption that Re ^ ^ 0. To summarize, we 
can eliminate the integration over h and the factor ip{h) in (|5.39|) . provided we 
double the factor 2, set /i = e in the argument of and replace Sooiahf^) 
by Xf-t-pli), in analogy to H4.28|l and the comment that follows it. Finally we 
combine the factors e~^''(a) and X!^+p(a) into the single expression Xi/-p(a) : 

P!^°iAT,E,) = 4C(i^ + l) X 




X Xi,^p{a) e{—xi — X3) dxi dx3 dy da . 



For each n e (Z — {0})^, there exists a unique Bn.f_i.ri G ^ characterized 

■^The integration with respect to y G M in the equivalent integral I5.39i was obtained by 
unfolding an integral over R/Z. 
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by the properties 

Tr^^r,{n{x,U,v))Bn,f^,r, = e{-niXi - n2X2 - 713X3) Bn,f_,,r, , , , 

, (5-42) 

Bn,t^,-n{n{x,u,v)) = e{niXi + n2X2 + nsxs) 

IS]; these identities are analogous to H4.25(l and use the notation (|5.16|) . The 
Bn,p,,ri corresponding to different values of n are related by the action of the 
diagonal subgroup A C G, but this need not concern us here. The cuspidality 
of T implies that the Fourier coefhcients in H5.17|l vanish whenever one or more 
of the indices are zero. Explicitly, 

a„ 7^ =^ 7^e(Z-{0})^ (5.43) 

Comparing (|5.42|) to 15.16|l and the definition (|5.38|) of Tabeiian, one finds 

T-abclian = X!„g(z_{0})3 ' (5.44) 

The inner integral in (|5.41|) picks out the terms in the sum corresponding to 
ni — n3 — I. Hence 

P^«{At,E,) = 4C(i^ + l) X 

We parameterize as in H4.19|l . Aq — {at | i e M}. Then Xi^-pi^t) = 
g(i'-i)t. ||4.30|) . Conjugating at across ni and using the transformation rule 
1)5. 9|l that defines W^J^, we can re- write (|5.45|) as follows: 

// 1 o\ . 1 n \\ (5.46) 



0001 



The passage from (I5.45|) to (15.46(1 also depends on the identity l(5.13|l . which 
implies (1 — /ii +/i2) + (1 ^ Ms + (^4) = 2 — 2(^i + ^3). Note that atfiia-t = rig^t; 
cf. H3.17|l . We appeal to the matrix identity 



iooo\/iooo\ /lo 0^/1 OOs 

(5.47) 

0001/Voooi/ Vooo'i^Vo 01- 



with z — e^*, the characterization 15.42|l of -B„.p,rj, and once more to 1)5.9(1 . to 
conclude 

PI°{At,E,) = 4(-l)''^C(^ + l) V ^ai.o X 

r (5.48) 
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We simplify the integrand by making the change of variables y ^ followed 
by the substitution x — |£| \y\~^ e^*. Then dx — 2xdt, hence 



+1 



e{y + {sgn£y)x 
7r {sgney)V2+m 



(5.49) 

aj^-pi-ps |y| dydx. 



Recall the definition (|5.20() of the exterior square L-function. We now separate 
the terms in (|5.49|) corresponding to positive and negative values of ^. Appealing 
to and inUHJl, we find 

P^"{At,E^) = 2Lm^, T , Ext^) X 



Jm (sgny)')2+'?3 

+ (-1)-/ / <f + N^-^^-^3|^|^-..-..,^,4. 

^ ^ ' ' (sgny)''2+'73 II 1^1 ^ ( 



The factor in curly parentheses equals 

r (-iy'^e(x + ;/) 
Jr2 {sgnx)^^+n^ {sgny)vi+V2 



1^1 -_,,_,3rf, ^ / <y) \y\^-..-..dy (5-^1) 



, (sgnx)''i+''3 Jr (sgny)''i+''2 

That completes the proof of the lemma. □ 
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